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HOW TO TAME YOUR SPARSITY CONSTRAINTS 


J. A. LOPEZ 


Abstract. We show that designing sparse Hoo controllers, in a discrete (LTI) 
setting, is easy when the controller is assumed to be an FIR filter. In this 
case, the problem reduces to a static output feedback problem with equality 
constraints. We show how to obtain an initial guess, for the controller, and then 
provide a simple algorithm that alternates between two (convex) feasibility 
programs until converging, when the problem is feasible, to a suboptimal Hoo 
controller that is automatically stable. As FIR filters contain the information 
of their impulse response in their coefficients, it is easy to see that our results 
provide a path of least resistance to designing sparse robust controllers for 
continuous-time plants, via system identification methods. 


1. Introduction 

Recently there has been much interest in designing controllers that satisfy so- 
called “sparsity constraints” -- a catch-all term for constraints that arise from infor¬ 
mation flow restrictions [Ml Hi iia HZ], by the control-loop topology ESH] , etc. 
The main difficulty in sparse controller design comes from the obscure relationship 
between sparsity constraints, imposed on the pattern of the closed-loop transfer 
matrix, and the closed-loop state-space description; which is where we prefer to 
work since modern control theory relies heavily on tools from linear algebra. As 
with non-sparse robust control design, there seem to be two principal roads to con¬ 
troller synthesis: the Youla parametrization and the linear matrix inequality (LMI) 
solutions. Some sparse control researchers have focused on determining theoretical 
conditions under which the Youla parametrization solution remains convex under 
sparsity constraints ED]; while others have made progress by adapting existing LMI 
tools so that they can extract sparse controllers by assuming an easier-to-work-with 
structure on the controller or in the LMI formulation Eiiini[ni. Our approach also 
imposes a structure on the problem: we assume the controller is an FIR filter (and 
therefore also assume the plant is strongly stabilizable) but we do not require the 
sparsity pattern to be in block form nor do we impose a structure on the LMI 
factors. Moreover, our method uses an alternating scheme that culminates with a 
controller and a certificate of stability and robust performance. Perhaps the closest 
work to ours is [14], where the authors also use an alternating scheme to design 
sparse controllers for the H 2 (static) state-feedback case. Our approach can be 
considered a generalization of their work since it includes static state-feedback con¬ 
troller design as a special case and can easily incorporate H 2 constraints, if desired. 
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However, unlike [T^, we will not search for an optimal solution since there is little 
to gain from achieving the lowest norm |23| . 

There are many advantages to using an FIR controller. We will show that by 
imposing this form on the controller, the problem of synthesizing (sparse) subopti- 
mal Hao controllers reduces to a static output-feedback problem, for an augmented 
system, with the sparsity constraints entering the problem through simple equality 
constraints. Although imposing an FIR structure also assumes the plant is strongly 
stabilizable, this assumption is not overly restrictive since it is not practical to im¬ 
plement unstable controllers, anyway [SlIIHli]. Apart from this assumption, we 
only assume that the plant is detectable and that the control inputs do not di¬ 
rectly feed-through to the output. Thus, our method only has mild restrictions 
and we will demonstrate that the resulting controllers attain excellent bounds on 
the Hao norm. The controllers are ultimately obtained using a simple algorithm 
that alternates between two (convex) feasibility programs until convergence, when 
the problem is feasible - while we do not pursue convergence guarantees, we take 
comfort in knowing that our algorithm is simpler than other alternating schemes 
(ADMM and expectation-maximization) for which convergence proofs are available 
mm- Furthermore, other alternating schemes like “D-K iteration” have had success 
in the past. 

In the following sections we will state the problem, present our main contribution, 
and demonstrate its use with examples. 


1.1. Preliminaries. Our notation is standard from the robust control literature 
|28l [29j [TT]. We consider the standard robust control loop shown in Figure 
where G represents the discrete-time plant, w represents the disturbance inputs, 
u the control inputs, 2 ; the regulated outputs, and y the outputs available to the 
discrete-time controller, K |23| . 



Figure 1. Closed-loop system 
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The state-space description is given by: 

(1) Xk+i = Axk -I- BiWk + B2Uk 

Zk = CiXk + DiiWk + Di2Uk 
Vk = C2Xk + D2lWk 


For this system, we would like to minimize the "Hoo norm of the transfer function 
from the disturbance inputs to the regulated outputs: 


( 2 ) 


Acl 

Bcl 

CcL 

Dcl 


where {Acl, Bcl,Ccl, Dcl) is the system with an output feedback controller 
u = Ky in the loop. Formally, we consider Problem 1 below. 


Problem 1. Given /i > 0 and a binary pattern matrix, S, find a stabilizing 
controller K G S such that UTzu,!!^ < /r. 

Assumptions: The assumptions we make are that the pair (A,i? 2 ) is strongly 
stabilizable, (A, C 2 ) is detectable, and that D 22 = om- 


For our solution, we turn to a standard result in the robust control literature 

m n m [u. 

Lemma 1. The inequality UTziuH^ < h- holds if, and only if, there is a symmetric 
matrix P such that 



P 

AP 

B 

0 

( 3 ) 

pA^ 

P 

0 

PC^ 

B^ 

0 

I 


is feasible. 

0 

CP 

D 



Next, we include a review on FIR realizations from Enn]. For this review, we 
will temporarily abuse the notation by also using 2 for the traditional z-transform 

n—1 

variable. If Q{z) is an, Finput, FIR filter with Q(z) = QiZ~\ then one state- 

i=0 


space realization is: 


( 4 ) 


with 


( 5 ) 


An-l 

rpn—l 

^n-1 

[Qn—h • ■ • 7 Ql] 

Qo 


0 0 

0 0 /, 

0 0 0 


0 

0 

h 

0 


^ -^nlxul 



■ h ' 


■ 0 ■ 


0 


0 

E'f = 

1 

0 ■ ■ ■ 

1_ 

jpn _ 

-1 

_ 1 


( 6 ) 


nl X I 
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For example, if 

(7) Q(0) = [1 + 2z-i+3z-2 1 + 22-i+3z-2 1 + 2z-i + 3^-2] 


then we will assume its state-space description has the form: 


( 8 ) 




■ 0 

/s 

, Bg = 

0 

0 

0 

h 

[1 

1 1 ], Qi = 

= [ 2 


, Cg= [ Q 2 Qi ] ,Dg = Qo, with 


Thus, besides being automatically stable, FIR filters have the satisfying property 
of clearly identifying entries in its transfer function with entries in its state-space 
description. (Clearly, Q{j, k) = 0 if, and only if, Qi{j, k) = 0 for all i.) This obviates 
any difficulty that comes with trying to associate entries in a general transfer matrix 
(i.e., one not required to be an FIR filter) with its state-space description via the 
transformation G{z) = C{zl — A)~^B + D which has an unfriendly inversion in 
the way. Furthermore, for a fixed n, Ag and Bg are also fixed. We will use this 
property, in the next section, where we show that Problem 1 reduces to a static 
output feedback problem, for an augmented system, when we require that: 


( 9 ) 



Bg 


Dg 


2. Main result 

In this section, we prove the following claim. 

Lemma 2. Problem 1 reduces to a static output feedback problem for the augmented 
system {Ao, Bo,Co, Do) where 


( 10 ) 


A 


0 


Di 


BqD 21 


“ [ BgC2 A J ’ - 

Co=[Ci 0], Do = Dn. 

Proof. With iF as in the closed-loop system is given by 


( 11 ) 


Acl = 


A + B2DgC2 B2Cg 
BgC2 Ag 


Bcl = 


Bi + B2DgD2i 
BgD21 


( 12 ) CcL — [ Cl + Di2DgC2 Di2Cg ] , Dcl — Du -\- Di2DgD2i. 

Following standard approaches min], we can parametrize the closed-loop system 


as: 


(13) 

Acl = 

(14) 

CcL = 

with 


(15) 

B = 

(16) 

D21 - 


'21 


'21 


B 2 

0 


C = 


0 I 

C 2 0 


£>12 = D 


12 , 


0 

-D 21 


and Ko=[ Cg Dg], 


Thus, the stability of the closed-loop system is determined by A^ + BKoC\ which 
the reader can recognize as the traditional output-feedback form. □ 
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Substituting the parametrized system into Lemma[2gives the required condition: 


(17) 

F{P,Ko) = 


P 

P{Ao + BKoC)^ 

{Bo + BK0D21V 


0 


{Ao + BKoC)P 
P 
0 


Bo + BK 0 D 21 
0 
/ 


{Co + Di2KoC)P Do + D12K0D2I 


0 

P{Co + Di 2 KoC)^ 

{Do + Di 2 KoD 2 if 


At this point, traditional approaches would deal with the non-convexity of this 
condition by lifting the non-convex terms, solving Lemma[2 and extracting Ko from 
the lifted variable using an inversion. The inversion is problematic when enforcing 
sparsity constraints and usually researchers require P to be diagonal so that a 
sparsity pattern can more easily be imposed on the controller. However, there may 
not be such a P. Here, we take an iterative approach. Define the matrix, Fq, as: 


> 0 


(18) 


Fo{P,Ko) = 


P 

PAl + {BKoC)^ 
{B 0 + BK 0 D 21 V 


0 


AoP + BKoC 
P 
0 

CoP + D 12 K 0 C 


Bo + BK 0 D 21 
0 
/ 

Do + D 12 K 0 D 21 


0 


PCJ + {Di2KoC)^ 

{Do + D 12 K 0 D 21 V 

fil 


which simply removes P from the non-convex terms. Define the two feasibility 
programs, Pq and P, as: 


min 0 

P,Ko 


(19) 

Fo{P,Ko)^^ 

1 subject to Qi G S, Vt 
[ Fo{P,Ko)>0 

(20) 

F{P,Ko)^ 1 

min 0 

P,Ko 

subject to Qi G S, Vi 


F{P,Ko)>0 


where Qi S S' is enforced using equality constraints determined by the zeros in S. 

We now define Algorithm to synthesize yu-optimal controllers, using SDP 
solvers. Below, the notation P(P, ATo)^ means /c-iterations of the feasibility pro¬ 
gram P (which is easily specified using the maximum-iterations input of the solver) 
and the bolded terms identify the decision variables in the program while the other 
terms are fixed, from the previous iteration. 

In practice. Algorithmic converged faster when the SDP solver was allowed more 
iterations when searching for P (i.e. when ki > ^ 2 ). We also found that changing 
fj, affected the speed of convergence. Setting k = [2,5,2] and then increasing ko 
with /j, set larger than the squared ("Hoc) norm of the closed-loop system with the 
full controller is a good place to stariQ 


> 0 


2.1. Pattern Discovery. In im, Lin et al. identified sparsity patterns using 
“sparsity promoting penalty functions”. Since Pq is a relaxation of P, it can be used 
to discover sparse patterns by simply adding an objective to Pq that minimizes, for 
example, the re-weighted £i-norm of Ko |1|. 


^For convenience, full H^o controller can be obtained using the MATLAB function hinfsyn. 
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Algorithm 1 Sparse Hoo Control Synthesis 

Input: fj, > 0, FIR order n, sparsity pattern S 
Output: {P,K) 

1; Ao^Po(P,Ko)'=« 

2: while F{P, Ko) < 0 do 
3; P^P(P,Ao)'=i 

4: if F{P,Ko) > 0 then 

5: return (P, Ko) 

6: else 

7: ^P(P,Ko)'== 

8 : end if 

9: end while 


Algorithm 2 Pattern Discovery 


Input: p, > 0, FIR order n, max iterations N, re-weighting constant e > 0 
Output: Pattern(Ao) 

1: IFo ^ 1 

2: while k < N do 


Kok t— 


mm \\Wk-i ■ Kok-i\\i 


subject to Fq{P,Ko) > 0 
Kok-i t— Kok 

Wk { i , j ) ^ 1/ {\ Kok { i , j ) + e|) 
k k + 1 

end while 
return Pattern(Ao) 


3. Examples 

The examples below were solved using MATLAB/CVX/SeDuMi/SDPT3 |161 171 

123 HSI- 


Example 1 This example was used to demonstrate distributed Poo synthesis in 
m and distributed P 2 synthesis in [S]. The goal is to design a diagonal controller 
for the (unstable) continuous-time plant below. 
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( 21 ) 


A = 


B2 = 


C2 = 

D21 = 


-2 

1 

1 

1 


■ 1 

0 

0 ■ 

CO 

0 

0 

2 

, B , = 

0 

0 

0 

-1 

0 

-2 

-3 

1 

0 

0 

-2 

-1 

2 

-1 


1 

0 

0 

-1 

0 



■ 1 

0 

-1 

0 ■ 

, Cl = 

0 

0 

0 

0 


0 

0 

0 

0 


1 

■ 0 

0 ■ 

, Dll = O 3 , Di 2 = 

1 

0 


0 

1 


0 1 0 
0 0 1 


D 22 = 02 


After discretizing using a zero-order hold with a 0.1s sampling period, we redefine 
A, Bi, and B 2 as: 


( 22 ) 


(23) 


(24) 


0.8189 

0.08627 

0.09004 

0.08133 

0.2524 

1.003 


0.03134 

0.2004 

-0.05449 

0.01017 

0.7901 

-0.258 

-0.1918 

-0.1034 

0.1602 

0.8604 

0.09531 

0 

0 





0.01447 

0 0 





0.08618 

0 0 





-0.001083 

1 

0 

0 





0.004532 

0.004367 




0.1001 

0.01005 




0.0003383 

-0.01361 




-0.005126 

0.09363 





Running Algorithm]^ using /i = 24 and k = [10, 5, 2], we obtain the following static 
controller (P is not shown to conserve space): 


(25) 


Ko = 


-1.2775 0 

0 -0.5685 


which results in jlTziulloo = 1-85 for the continuous-time system. Using the same k, 
and fj, = 9, we obtain the following first-order controller: 


(26) 


Ki 


-0.6543z-0.5344 


0 


0 

-0.1993z-0.2237 


z 


which results in jlTzmlloo = 1-9043 for the discrete-time system. 

The continuous-time equivalent was identified (individually), using the MATLAB 
function tfest (id_data, 1,0) , to obtain 


Ki 


-8.469 

s-l-7.382 


0 


0 

-4.167 
s-l-10.24 . 


(27) 
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which results in UTzmlloo = 1-9517 for the continuous-time system. 


(28) 


K2 


-0.6377z^-0.2514z-0.3369 

z2 

0 


0 

-0.228z^-0.1406z-0.2332 

z2 


was obtained using fj, = 9 and k = [12,5,2] - this controller results in ||Tzu,||oo = 
1.9795. 

The continuous-time equivalent is given by: 


(29) 


K2 


-189.7 

s2+40.21s+157.8 

0 


0 

-6.11e04 

s2+565.7s+1.254e05 - 


and results in ||Tzuj||oo = 1.9711. All three controllers have slightly better closed- 
loop 'Hoc, performance than the ones obtained in 122!, the best of which result in 

iit;„iIoo = 1-995. 

Example 2 The following continuous-time example is from j20j . 


G{s) 


s+l 

1 

s+1 


0 

1 

s-1 

1 

s-1 

1 

s-1 

1 


0 

0 

1 

11 ^ 

s+1 s+1 


0 

0 

0 

1 

s+1 


(30) 
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For this model, the following realization is used: 


(31) 


(32) 


(33) 


(34) 


-1 

0 

0 

0 


0 ■ 


0 

1 

0 

0 


0 


0 

0 - 

-1 

0 


0 


0 

0 

0 

-1 


0 


0 

0 

0 

0 


1 


0.2 

0 

0 


0 

0 

0 

0.2 

0 


0 

0 

0 

0 

0.2 


0 

0 

0 

0 

0 

0.2 

0 

0 

0 

0 


0 

0.1 

2 0 

0 

0 

0 ■ 




0 2 

0 

0 

0 




0 0 

2 

0 

0 




0 0 

0 

2 

0 




0 0 

0 

0 

1 




0.05 

0 


0 


0 


0.05 

0.05 

0 


0 


0.05 

0.05 0.05 


0 


0.05 

0.05 0.05 


0.05 

0.05 

0.05 0.05 


0.05 

0.5 

0 

0 


0 

0 

" 

0.5 

0.5 

0 


0 

0 


0.5 

0.5 

0.5 


0 

0 


0.5 

0.5 

0.5 

0.5 

0 


0.5 

0.5 

0.5 

0.5 

1 



^11 = Di 2 = D 22 = D 22 = O5. 


0 

0 

0 

0 

0.1 


After discretizing, using a sampling period of 0.05 s, redefine A, Bi, and B 2 as: 


(35) A = 


( 36 ) 


Bi = 


0.9512 

0 

0 

0 

0 


0 

1.051 

0 

0 

0 


0 

0 

0.9512 

0 

0 


0 

0 

0 

0.9512 

0 


0 

0 

0 

0 

1.051 


0.009754 


0 

0 

0 

0 

0 

0.01025 

0 

0 

0 

0 


0 0.009754 

0 

0 

0 


0 

0 

0.009754 

0 

0 


0 

0 

0 

0.005127 
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As in [20] , we would also like to find a first-order controller that satisfies the sparsity 
constraint: 


(37) 


S = 


0 0 0 0 0 
0 10 0 0 
0 0 0 0 0 
0 0 0 0 0 
0 0 0 0 1 


Setting /r = 0.1 and k = [2, 5, 2], Algorithmobtains the following controller: 


(38) 


Ki 


0 0 0 0 0 

Q — 9-265z—^.227^ 0 0 0 

0 0 0 0 0 

0 0 0 0 0 

Q Q 0 0 —12.68^—15.84 


which results in UTzujIIoo = 0.0163. 

The continuous-time equivalent was identified, using the MATLAB function 
tfest (id_data, 1,0), and re-assembled to obtain: 


(39) 


Ki 


0 

0 

0 

0 

0 


0 

-120 

s+8.501 

0 

0 

0 


0 0 
0 0 
0 0 
0 0 
0 0 


0 

0 

0 

0 

-616.7 
s+22.48 . 


which results in the same closed-loop cost. Additionally, a static controller can be 
obtained (using the same settings): 


(40) 


Ko = 


0 0 0 0 0 

0 -9.1093 0 0 0 

0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 -12.372 


which results in the same cost, HT^^Hoo = 0.0165, for both systems. 


Example 3 A limitation of our approach is that, presently, SDP solvers can only 
handle medium-sized problems. For instance, the examples in m were too large 
to solve on a 2-core computer with 4GB of memory. On the other hand, we were 
able to identify sparser patterns and synthesize sparser controllers than their ap¬ 
proach. This example is a smaller version of the mass-spring example in |14| . The 
plant model is a classical mass-spring system with Nm = 8 unit masses and spring 


constants. 





(41) 

A = 

0 

-T 

I ' 
0 

, Bi 

(42) 

Cl = C2 = Q 

1/2 

5 

Dll 

(43) 

Di 2 = D 22 = 

■ i?l/2 ■ 

0 
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with T an Nm x Nm tridiagonal Toeplitz matrix with —2 on the main diagonal 
and 1 on the sub- and super diagonals. The / and 0 terms are x identity- 
and zero matrices, respectively. R = 10/ and Q = l 2 N^ ■ After discretizing, using 
a sampling period of 0.5 s, the A,Bi, and B 2 matrices were redefined as in the 
previous examples. 

A controller for this system is partitioned as Kq = [Kp, Ky] corresponding to the 
position- and velocity states. Applying Algorithm with = 80, n = 2, N = 40, 
revealed diagonal patterns for Kp and Ky, which agrees with m- However, the 
entries corresponding to Kp were closer to zero and several times smaller than the 
Ky terms. Thus, we hypothesized that it is possible to design controllers with the 
pattern S = [0, /] - this agrees with our intuition that it should be possible to 
control this system using velocity feedback. 

Setting fj, = 83 and k = [10, 5, 2], Algorithm obtained the following controller: 

(44) Kp = 0jv„ 


(45) 


at a cost of ||rzu,||oo 


Ky 


8.2909. 


/ 


-0.7491 

-0.706 


diag 


-0.7255 

-0.7316 

-0.7316 

-0.7255 


-0.706 


V 


-0.7529 


\ 


/ 


4. Conclusions 


We presented a very simple method for solving a very difficult problem that seems 
to work well for strongly stabilizable plants. Broadly speaking, the idea behind the 
solution is in line with other approaches to attacking non-convex problems: by 
breaking it up into smaller problems or step^ The method is aided by the fact 
that Pq tends to provide very good initial guesses and probably deserves more 
attention on its own. 

The method is flexible and, as in Algorithm the feasibility programs can in¬ 
clude other objectives. The flexibility can be used to optimize additional objectives 
and it can be used to enhance convergence for very difficult cases. For example, in 
Example 3, it is possible to synthesize a still sparser Ky if we minimize |iT ’||2 + ||Qi ||2 
in Pq. We left this out for clarity, but it could be researched further. 
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